Skip to main content
Loading...
Skip to article
  • Qualtrics Platform
    Qualtrics Platform
  • Customer Journey Optimizer
    Customer Journey Optimizer
  • XM Discover
    XM Discover
  • Qualtrics Social Connect
    Qualtrics Social Connect

Displaying Messages Based on Scoring


Was this helpful?


This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

The feedback you submit here is used only to help improve this page.

That’s great! Thank you for your feedback!

Thank you for your feedback!


About Displaying Messages Based on Scoring

The scoring feature allows you to use Qualtrics to create tests, measure respondents’ skills, and assess people in a myriad of ways. But when it comes to assessments, we want to communicate different things to people based on how they performed. We can congratulate people who scored 100%, but we might want to provide guidance and study guides to those who scored below a 75%. Maybe we’re running a personality assessment, and want to tell the respondent what profile matches their results.

This page details how to give different end of survey messages to respondents based on their scores.

Qtip: Of all project types, this solution is best for survey projects.

Scoring

Before you proceed, make sure you set up scoring in your survey. See our Scoring support page for more details on this process.

Make sure you figure out your scoring brackets ahead of time, since everyone’s set up is a little different. For example, let’s say the maximum number of points you can gain in a category is 35. You might want to look at people who scored 1-15, 16-20, and 21-35.

You will also want to make sure that you do not automatically show respondents their scores at the end of the survey. This setting will interfere with the message we want to create, which can also include the score.

Removing end of scoring messages

  1. Go to Scoring Options.
  2. Make sure At the End of the Survey is not selected.
    Qtip: It is ok to have After Each Question selected!
  3. Use the dropdown to make sure none of your categories have this selected.
  4. Click Save.

Survey Setup

Qtip: This method works best if there is only one scoring category you want to base messages on. If you want to use a combined score of all categories, create a new category called Overall Score and score the questions accordingly.

In this example, we have a survey whose All Items scoring category has a maximum of 100 points. We are interested in creating messages for four different scoring brackets: 0-50, 50-75, 75-88, and 88-100.

  1. Make sure your scoring is set up as described in this section.
  2. In your survey editor, navigate to the Survey flow.
    Going to Survey Flow. Adding an Embedded Data element
  3. Click Add a New Element Here and select Embedded Data.
  4. Name your score. For example, here we just call it Score.
    Labels embedded data field
  5. Click Set a value now. Click the dropdown and highlight Insert Piped Text. Then highlight Scoring and select the category whose score you want to display. Here, we called the category All Items.
  6. Click Score.
  7. Your value will now be piped text. This is code surrounded by French brackets ( { a } ).
    Add a branch for logic
  8. Click Add a New Element Here and select Branch.
  9. Click Add a Condition.
    Customize branch logic
  10. Select Embedded Data from the first dropdown.
    Set a criteria for the branch logic
  11. Type the name of your new Embedded Data. Here, it’s Score.
    Qtip: Don’t move your Embedded Data element! It needs to be after the blocks, but before the branches we will create. That will make sure the survey knows the full score before sending people down certain branches.
  12. Type a value, and choose whether this is less than, greater than, equal to, etc. Here, we set it up to be “Less Than or Equal to 35.”
  13. Click OK.
  14. Indented under the branch, click Add a New Element Here and select End of Survey.
    Add an end of survey element

    Qtip: It is very important that you click the link indented under the branch! We want this element to only be shown to respondents if they pass the branch! Move the element if you create it in the wrong spot.
  15. Click Customize.
  16. Select Override Survey Options.
    Adding a custom message by following the menus
  17. Select Custom end of survey message.
  18. Click Select a message, then hover over your library, then click New Message.
  19. Create a message in the field. Here are some general guidelines:
    Sample message has score piped in and a helpful name

    • Use the Piped Text button ( {a} ) to display the respondent’s score.
    • If you want to give the maximum score (eg., you scored X/100), you will have to manually type this value.
      Adding piped text
    • To learn more about adding font effects and images using the Rich Content Editor, see the linked support page.
    • If you want to use similar messages in different surveys, make sure you adjust the Piped Text.
  20. Add a Description. This is the name that appears in the library. Try to give a name that will help you remember what the message contains – for example, adding the score range it’s for, as well as the survey it’s for.
  21. Click Save.
  22. Click OK.
    Saving end of survey customization by clicking green OK in lower-right
  23. Repeat steps 8-22 for every one of your scoring brackets.
    Example: For the second branch, we made the branch say “Greater Than 35” AND “Less Than or Equal to 50.” Since the first branch includes scores equal to 35, we say “greater than” (not “greater than or equal to”) to make sure there’s no overlap.
    Example branch as described
    We also make sure the two conditions are joined by And because both must be true – otherwise, everyone with a score greater than 35 OR less than 75 will be included. That means that people with scores less than 35 will be included, which we are trying to avoid!
  24. Once you are finished, click Apply.
    Apply button in blue on lower-right

Here are what our scoring brackets look like, as an example:

Four branches

Multiple Messages for Multiple Categories

There can only be one end of survey message for each respondent. This message can contain whatever you want, including multiple scoring categories, or additional information saved in the survey.

However, let’s say you have 3 categories: Math, Vocabulary, and Reading Comp. Respondents can perform well in one and not the other – for example, maybe I struggled with Vocabulary and Reading Comprehension, but did well on Math. I might need different resources, or to speak to different teachers depending on how I performed.

If you want messages that reflect different messages for ranges within each scoring category, follow the steps below.

Qtip: This method will make it easier to give different scores based on performance in different categories. However, because respondents may forget to click “Submit” at the end, you may end up with responses marked incomplete despite all the questions being answered. So long as your Incomplete survey responses options say to record (not delete) these responses, this will not hurt your data in any way. This is explained again in the steps below.
  1. Make sure each of your scoring categories is set up.
  2. In your survey editor, navigate to the Survey options.
    Survey options configured as steps describe
  3. Go to Responses.
  4. Under Incomplete survey responses, make sure it’s set to Record. You may set any time limit and other settings you want to include.
  5. In the survey builder, scroll to the bottom and click Add Block. This is where we will create all the end of survey messages.
    Add Block button
  6. Go to the Survey Flow.
    Survey flow; adding embedded data between the vocab block and block 4, where end messages are being written
  7. On your second to last block, click Add Below.
  8. Select Embedded Data.
  9. Name this embedded data after one of your scoring categories. For example, here it’s “Reading Comp.”
    Selecting values from a menu to build embedded data
  10. Click Set a value now. Click the dropdown and highlight Insert Piped Text. Then highlight Scoring and select the category of the same name. Here, it’s “Reading Comp.”
  11. Click Score.
  12. Your value will now be piped text. This is code surrounded by French brackets ( { a } ).
    Final embedded data
  13. Click Add a New Field. Repeat steps 9-13 for each scoring category you have.
  14. Click Apply when you’re done.
  15. In your new, final block, click the Add a new question button.
    Add a new question button bottom-right of every block, once clicked shows a list of question types
  16. Choose Text / Graphic.
  17. Click on the text / graphic’s content.
    Clicking into question
  18. Click Rich Content Editor.
  19. Write your first message here.
    Rich Content Editor with a message inside Here are some general guidelines:

    • Use the piped text button ( {a} ) to display the respondent’s score.
    • If you want to give the maximum score (eg., you scored X/100), you will have to manually type this value.
      Adding piped text
    • To learn more about adding font effects and images using the Rich Content Editor, see the linked support page.
    • If you want to use similar messages in different surveys, make sure you adjust the Piped Text.
    • You must instruct the students to click the “Next” button.
  20. Select Display logic.
    Question is selected; to editing pane on left, display logic is highlighted
  21. Select Embedded Data from the first dropdown.
    Adding Display Logic
  22. Enter the name of the category (eg., Math) the message is for. You may use the dropdown arrow.
  23. Type a value, and choose whether this is less than, greater than, equal to, etc. Here, we set it up to be “Less Than or Equal to 35.”
  24. Click Save.
  25. Repeats steps 16-25 for every category and every scoring range you’d like to create a special message for.

Respondents will only see messages relevant to them. For example, if I score well on math and vocabulary, but poorly on reading comprehension, I will see three different messages, one for each category.

Respondents’ scoring messages will be on separate pages, and the respondent will have to click Next to read each score and submit the survey.